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Technology  Transfer 

We  collaborate  with  a  group  at  the  Information  Technology  Laboratory  (ITL)  at  the  US  Engineer  Research  and  Development 
Center  (ERDC)  on  applying  our  results  to  thermal  inverse  problems  in  the  near-surface  vadose  zone.  The  group  at  ITL  includes 
Corey  Winton,  a  student  of  the  PI  who  was  supported  by  a  previous  ARC  grant.  Our  other  collaborators  at  ITL  are  Owen 
Esiinger,  Amanda  Hines,  and  Jeff  Hensley.  Our  collaborators  at  CHL  are  Stacy  Howington,  Charles  Berger,  Matthew  Farthing, 
Jackie  Pettway,  and  Chris  Kees. 


Final  Report  for  Army  Research  Office  grant 
#  W911NF-11-1-0367 

Algorithms  for  Model  Calibration  of  Ground  Water  Simulators 
Reporting  period:  9/16/11  -  09/15/14 

1.  Forward.  The  objectives  of  this  project  are  to 

•  design,  analyze,  and  implement  novel  algorithms  for  model  calibration  including: 

—  methods  for  noisy  and  ill-conditioned  nonlinear  least  squares  problems, 

—  reduced  order  models  (such  as  POD  and  sparse  interpolation),  and 

—  methods  based  on  Bayesian  analysis  which  are  part  of  uncertainty  quantihcation. 

•  simulation  methods  such  as: 

—  flow  in  the  vadose  zone  and  non-Darcy  flow  models, 

—  linear  solvers  and  preconditioning  methods  for  those  solvers,  and 

—  nonlinear  solvers,  especially  pseudo-transient  continuation. 

The  primary  focus  of  this  project  is  model  calibration.  The  secondary  objectives  are  con¬ 
tinuations  of  previous  ARO-funded  projects.  However,  reduced  order  models  for  unsaturated 
flow  may  become  important  in  the  current  work  we  do  with  ERDC. 

We  collaborate  with  a  group  at  the  Information  Technology  Laboratory  (ITL)  at  the 
US  Engineer  Research  and  Development  Center  (ERDC)  on  applying  our  results  to  thermal 
inverse  problems  in  the  near-surface  vadose  zone.  The  group  at  ITL  includes  Corey  Winton, 
a  student  of  the  PI  who  was  supported  by  a  previous  ARC  grant.  Our  other  collaborators 
at  ITL  are  Owen  Eslinger,  Amanda  Hines,  and  Jeff  Hensley.  Our  collaborators  at  CHL  are 
Stacy  Howington,  Charles  Berger,  Matthew  Earthing,  Jackie  Pettway,  and  Chris  Kees. 

1.1.  Students.  This  project  supports  Anna  (Meade)  Fregosi,  a  Ph.  D.  student.  Fregosi 
spent  the  summers  of  2011  and  2012  at  ERDC  working  on  model  calibration  and  thermal 
inverse  problems  in  the  subsurface.  We  have  two  paperssubmitted  and  one  in  preparation  on 
this  work  and  Fregosi  will  take  her  preliminary  oral  exam  in  January  2015.  Corey  Winton 
graduated  in  December  2012  and  is  now  working  at  ERDC.  Winton  was  supported  from  a 
previous  ARC  project  and  was  stationed  at  ERDC  when  he  hnished  his  degree. 

2.  Problems  Studied.  In  this  project  we  have  worked  on 

•  thermal  inverse  problems  in  soil  with  Eregosi  and  the  group  at  ITL, 

•  algorithms  and  solvers  with  Kees  and  Farthing  from  CHL, 

•  reduced  order  models  for  model  calibration  and  inverse  problems  with  Winton  and 
the  group  at  ITL, 

•  pseudo-transient  continuation  theory, 

•  accelerators  for  hxed-point  iteration, 

•  non-Darcy  flow  models  in  a  separate,  but  related,  project,  and 

•  solvers  for  nonlinear  equations  and  optimization  problems  with  low- accuracy /random 
residuals. 

3.  Results.  In  this  period  seven  papers  [2-4,  6, 11,  15,  17]  have  been  submitted  and 
hve  [7-10, 18]  have  appeared. 

The  PI  and  his  students  have  given  twenty-two  presentations  based  on  our  work. 
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3.1.  Solvers.  We  were  invited  to  include  many  of  our  results  from  the  past  several  years 
in  a  substantial  review  article  [8].  That  paper  covered  a  broad  range  of  issues  in  simulation. 
Kees  and  Farthing  from  ERDC  were  two  of  the  many  other  authors  of  that  paper. 

Pseudo-transient  continuation  is  a  way  to  integrate  time-dependent  equations  to  steady 
state  without  having  to  capture  transient  behavior  which  is  not  of  interest.  This  has  been  of 
use  to  ERDC  [14]  in  surface  water  flow  codes,  and  is  a  very  important  method  in  combustion 
computations.  In  [7]  we  analyze  an  explicit  form  of  this  algorithm. 

We  are  also  investigating  Anderson  acceleration,  also  known  as  Pulay  mixing  [1,12,13]. 
This  is  a  method  for  accelerating  fixed  point  iteration  when  Jacobian  information  is  either 
not  available  or  too  expensive  to  compute  and  store.  The  method  has  recently  been  applied 
to  subsurface  flow  simulations  [16]. 

Anderson  acceleration  builds  a  new  iterate  from  a  linear  combination  of  prior  residuals, 
computing  the  coefficients  by  minimizing  a  linear  residual.  In  the  minimal  storage  case 
Anderson  is  identical  to  fixed  point  iteration.  In  [15]  we  report  on  the  first  convergence 
analysis  for  Anderson  acceleration  and  show  that  the  norm  in  which  the  linear  residual  is 
minimized  can  make  a  signihcant  difference  in  the  performance  of  the  solver. 

We  have  also  investigated  the  performance  of  solvers  when  the  nonlinear  residual,  Ja¬ 
cobian,  and  Jacobian- vector  products  are  computed  with  a  Monte  Carlo  simulation.  This 
situation  differs  from  the  textbook  case  [5]  in  that  one  does  not  have  errors,  but  variances. 
This  difference  causes  signihcant  changes,  both  in  theory  and  in  practice,  from  the  standard 
case.  We  have  submitted  one  paper  on  this  [17]  and  one  has  been  accepted  [18]. 

These  two  lines  of  work  have  potential  applications  to  hydrology  and  subsurface  reme¬ 
diation.  Anderson  acceleration  is  a  natural  method  for  multi-physics  coupling  (for  example 
subsurface  how,  chemistry,  and  heat  transfer)  when  the  individual  physics  codes  cannot 
be  combined  into  a  single  package  for  which  one  can  compute  a  Jacobian.  Residuals  with 
poor  accuracy  due  to  internal  Monte  Carlo  simulations  are  not  rare,  and  will  become  more 
common  as  high-performance  computers  become  larger  and  fault-tolerance  becomes  more 
important.  Monte  Carlo  simulations  are  naturally  fault-tolerant,  but  are  also  much  less 
accurate  than  conventional  simulations  and  interact  with  the  solvers  in  very  diherent  ways 
than  deterministic  simulations  do. 

3.2.  Model  Calibration.  One  paper  on  reduced  order  models  [10]  has  appeared  in 
print  and  another  has  been  submitted  [11].  Fregosi  has  made  good  progress  and  we  have 
completed  two  paper  in  collaboration  with  ERDC  stah.  The  hrst  of  these  [3]  takes  a  con¬ 
ventional  nonlinear  least  squares  approach.  The  second  [4]  compares  various  approaches  to 
Bayesian  inference  and  uncertainty  quantihcation.  A  third,  and  hnal  paper,  will  be  on  the 
variably  saturated  case.  When  the  work  on  that  paper  is  complete,  Fregosi  will  graduate. 
The  PI  and  Fregosi  visited  ERDC  in  May  of  2014. 

3.3.  Work  in  Progress.  Fregosi  has  completed  her  work  on  the  saturated  case  [4]  follow 
up  our  hrst  paper  with  Eslinger.  The  problem  is  a  thermal  inverse  problem  (determine  soil 
properties  from  temperature  measurements)  in  the  upper  30cm  of  the  subsurface  for  several 
regions  of  the  Earth.  ERDC  took  data  in  held  studies  and  we  are  using  this  resource  in  our 
work.  The  hrst  two  papers  [4], on  the  constant  saturation  case,  which  covers  some,  but  not 
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all  of  the  data.  The  hnal  part  of  Fregosi’s  work  will  be  on  the  variably  saturated  cases. 

We  continue  to  work  on  non-Darcy  flow  models  with  a  group  at  the  University  of  North 
Carolina  and  a  student  Deena  Hannoun,  who  is  supported  by  an  NSF  grant.  That  modeling 
questions  for  that  project  took  longer  to  resolve  that  we  expected,  but  we  now  have  good 
hts  to  data  and  the  paper  is  almost  ready  to  submit.  That  work  should  leverage  the  NSF 
support  to  inform  model  design  for  this  project.  Deena  Giffen,  the  NSF-supported  student 
on  the  project,  will  interview  at  ERDC  in  December. 
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